New Frontiers in Applied Data Mining

Visualizing temporal cluster changes using Relative Density Self%2DOrganizing Maps.

Visualizing temporal cluster changes using Relative Density Self%2DOrganizing Maps.

ReDSOM Relative Density Visualization of Temporal Changes in Cluster Structures Using Self%2DOrganizing Maps.

Exploratory Hot Spot Profile Analysis Using Interactive Visual Drill%2DDown Self%2DOrganizing Maps.


Mining Unexpected Temporal Associations Applications in Detecting Adverse Drug Reactions.


Exploratory Multilevel Hot Spot Analysis Australian Taxation Office Case Study.

A Survey of Open Source Data Mining Systems.

Data Mining and Analytics 2006
by the CRC for Construction Innovation. This delegation is contained in Clause 30
Neighborhood Density Method for Selecting Initial Cluster Centers in K%2DMeans Clustering.

Data Mining %2D Theory%2C Methodology%2C Techniques%2C and Applications

Neighborhood Density Method for Selecting Initial Cluster Centers in K%2DMeans Clustering.

Identifying Risk Groups Associated with Colorectal Cancer.

A Delivery Framework for Health Data Mining and Analytics.
The i Health Explorer tool, developed by CSIRO and DoHA, delivers web services type data mining and analytic facilities over a web interface, providing desktop access to sophisticated analyses over very large data collections. The tool allows users to access large transactional datasets to create profiles of selected patients. The patients&#039; profiles, together with windowed event sequences data, can then be analyzed using a user chosen data mining tool. The results of the analysis can then be visualized using various forms of knowledge representation methods. Although the initial implementation of the tool is focused on its application in adverse drug reaction exploration, this tool and the embedded data mining tools can be used in broad areas of health data analysis.
Mining risk patterns in medical data.
In this paper, we discuss a problem of finding risk patterns in medical data. We define risk patterns by a statistical metric, relative risk, which has been widely used in epidemiological research. We characterise the problem of mining risk patterns as an optimal rule discovery problem. We study an anti-monotone property for mining optimal risk pattern sets and present an algorithm to make use of the property in risk pattern discovery. The method has been applied to a real world data set to find patterns associated with an allergic event for ACE inhibitors. The algorithm has generated some useful results for medical researchers. Categories and Subject Descriptors
Representing Association Classification Rules Mined from Health Data.
Abstract. An association classification algorithm has been developed to explore adverse drug reactions in a large medical transaction dataset with unbalanced classes. Rules discovered can be used to alert medical practitioners when prescribing drugs, to certain categories of patients, to potential adverse effects. We assess the rules using survival charts and propose two kinds of probability trees to present them. Both of them represent the risk of given adverse drug reaction for certain categories of patients in terms of risk ratios, which are familiar to medical practitioners. The first approach shows risk ratios when all rule conditions apply. The second presents the risk associated with a single risk factor with other parts of the rule identifying the cohort of the patient subpopulation. Thus, the probability trees can present clearly the risk of specific adverse drug reactions to prescribers. 1
Representing Association Classification Rules Mined from Health Data.
Abstract. An association classification algorithm has been developed to explore adverse drug reactions in a large medical transaction dataset with unbalanced classes. Rules discovered can be used to alert medical practitioners when prescribing drugs, to certain categories of patients, to potential adverse effects. We assess the rules using survival charts and propose two kinds of probability trees to present them. Both of them represent the risk of given adverse drug reaction for certain categories of patients in terms of risk ratios, which are familiar to medical practitioners. The first approach shows risk ratios when all rule conditions apply. The second presents the risk associated with a single risk factor with other parts of the rule identifying the cohort of the patient subpopulation. Thus, the probability trees can present clearly the risk of specific adverse drug reactions to prescribers. 1
Exploring Possible Adverse Drug Reactions by Clustering Event Sequences.

Conceptual Mining of Large Administrative Health Data.

Temporal Sequence Associations for Rare Events.

Conceptual Mining of Large Administrative Health Data.

On%2DLine Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms.
Outlier detection is a fundamental issue in data mining, speci cally in fraud detection, network intrusion detection, network monitoring, etc. SmartSifter, which we abbreviate as SS, is an outlier detection engine adrressing this problem from the viewpoint of statistical learning theory. This paper provides a theoretical basis for SS and empirically demonstrates its effectiveness. SS detects outliers in an online process through the on-line unsupervised learning of a probabilistic model (using a finite mixture model) of the information source. Each time a datum is input SS employs an on-line discounting learning algorithm to learn the probabilistic model. A score is given to the datum based on the learned model, with a high score indicating a high possibility of being a statistical outlier. The novel features of SS are: 1) it is adaptive to non-stationary sources of data; 2) a score has a clear statistical/information-theoretic meaning; 3) it is computationally inexpensive; and 4) it can handle both categorical and continuous variables. An experimental application to network intrusion detection shows that SS was able to identify data with high scores that corresponded to attacks, with low computational costs. Further experimental application has identified a number of meaningful rare cases in actual health insurance pathology data from Australia&#039;s Health Insurance Commission. 1.
Association Rule Discovery with Unbalanced Class Distributions.
There are many methods for finding association rules in very large data. However it is well known that most general association rule discovery methods find too many rules, which include a lot of uninteresting rules. Furthermore, the performances of many such algorithms deteriorate when the minimum support is low. They fail to find many interesting rules even when support is low, particularly in the case of significantly unbalanced classes. In this paper we present an algorithm which finds association rules based on a set of new interestingness criteria. The algorithm is applied to a real-world health data set and successfully identifies groups of patients with high risk of adverse reaction to certain drugs. A statistically guided method of selecting appropriate features has also been developed. Initial results have shown that the proposed algorithm can find interesting patterns from data sets with unbalanced class distributions without performance loss.
Mining the Data Stream.
Abstract: Mining data streams has raised a number of research challenges for the data mining community. These challenges include the limitations of computational resources, especially because mining streams of data most likely be done on a mobile device with limited resources. Also due to the continuality of data streams, the algorithm should have only one pass or less over the incoming data records. In this article, our Algorithm Output Granularity (AOG) approach in mining data streams is discussed. AOG is a novel adaptable approach that can cope with the challenging inherent features of data streams. We also show the results for AOG based clustering in a resource constrained environment.
Estimating Episodes of Care Using Linked Medical Claims Data.
Australia has extensive administrative health data collected by Commonwealth and state agencies. The value of the health data is how quickly and e#ectively the data can be converted into useful knowledge independent of its quantity and quality. Using a unique cleaned and linked administrative health dataset we address the problem of empirically defining episodes of care. An episode of care is a time interval containing medical services relating to a particular medical situation. In this paper the medical situation is a hospital admission. The medical services of interest are pathology tests, diagnostic imaging and noninvasive investigative procedures performed before or after the hospital admission, but `associated&#039; with the hospital admission. The task can be viewed as detecting a signal in a time series relating to a hospital admission, distinct from the background noise of on-going medical care. Our approach uses an ensemble (panel of experts) paradigm where we implement multiple agents (alternative predictive models) to independently estimate intervals and then combine good interval estimates using a voting scheme. The results have been used in a study for the Commonwealth Department of Health.
Outlier Detection Using Replicator Neural Networks.
We consider the problem of finding outliers in large multivariate  databases. Outlier detection can be applied during the data cleansing  process of data mining to identify problems with the data itself, and  to fraud detection where groups of outliers are often of particular interest.
Mining Temporal Patterns from Health Care Data.

A Comparative Study of RNN for Outlier Detection in Data Mining.
We have proposed replicator neural networks (RNNs) as an outlier detecting algorithm [15]. Here we compare RNN for outlier detection with three other methods using both publicly available statistical datasets (generally small) and data mining datasets (generally much larger and generally real data). The smaller datasets provide insights into the relative strengths and weaknesses of RNNs against the compared methods. The larger datasets particularly test scalability and practicality of application. This paper also develops a methodology for comparing outlier detectors and provides performance benchmarks against which new outlier detection methods can be assessed.
Knowledge Discovery and Data Mining %2D PAKDD 2001

Advances in Artificial Intelligence. PRICAI 2000 Workshop Reader



Feature Selection for Temporal Health Records.
In this paper we consider three alternative feature vector representations of patient health records. The longitudinal (temporal), irregular character of patient episode history, an integral part of a health record, provides some challenges in applying data mining techniques.
Temporal Data Mining Using Hidden Markov%2DLocal Polynomial Models.

Temporal Data Mining Using Multilevel%2DLocal Polynominal Models.

On%2Dline unsupervised outlier detection using finite mixtures with discounting learning algorithms.
Outlier detection is a fundamental issue in data mining, speci cally in fraud detection, network intrusion detection, network monitoring, etc. SmartSifter, which we abbreviate as SS, is an outlier detection engine adrressing this problem from the viewpoint of statistical learning theory. This paper provides a theoretical basis for SS and empirically demonstrates its effectiveness. SS detects outliers in an online process through the on-line unsupervised learning of a probabilistic model (using a finite mixture model) of the information source. Each time a datum is input SS employs an on-line discounting learning algorithm to learn the probabilistic model. A score is given to the datum based on the learned model, with a high score indicating a high possibility of being a statistical outlier. The novel features of SS are: 1) it is adaptive to non-stationary sources of data; 2) a score has a clear statistical/information-theoretic meaning; 3) it is computationally inexpensive; and 4) it can handle both categorical and continuous variables. An experimental application to network intrusion detection shows that SS was able to identify data with high scores that corresponded to attacks, with low computational costs. Further experimental application has identified a number of meaningful rare cases in actual health insurance pathology data from Australia&#039;s Health Insurance Commission. 1.
Artificial Intelligence in Industry.
In many industrial applications, large centralized software systems are not as effective as distributed networks of relatively simpler computerized agents. For example, to compete effectively in today&#039;s markets, manufacturers must be able to design, implement, reconfigure, resize, and maintain manufacturing facilities rapidly and inexpensively. Because modern manufacturing depends heavily on computer systems, these same requirements apply to manufacturing control software, and are more easily satisfied by small modules than by large monolithic systems.  This paper reviews industrial needs for Distributed Artificial Intelligence (DAI), giving special attention to systems for manufacturing scheduling and control. It describes a taxonomy of such systems, gives case studies of several advanced research applications and actual industrial installations, and identifies steps that need to be taken to deploy these technologies more broadly.
Mining taxation data with parallel BMARS.
A new parallel version of Friedman&#039;s Multivariate Adaptive Regression Splines  (MARS) algorithm is discussed. By partitioning the data over the processors of  a parallel computational system one achieves good parallel eciency. Instead  of using truncated power basis functions of the original MARS, the new method  (BMARS) utilises B-splines which improves numerical stability and reduces the  computational cost of the procedure. In addition, the coecients of the basis  functions of a BMARS model provide quickly accessible information about  the local behaviour of the function. The algorithm has a time complexity  proportional to the number of data records. The method provides a new means  for the detection of areas in the space of features which are characterised by  the \interesting&#034; patterns of response values. This is applied to searching for  classes of incorrect tax returns using multiple predictor variables or features. The
The Integrated Delivery of Large%2DScale Data Mining The ACSys Data Mining Project.

Evolutionary Hot Spots Data Mining %2D An Architecture for Exploring for Interesting Discoveries.

Mining the Knowledge Mine The Hot Spots Methodology for Mining Large Real World Databases.
As databases grow in size and complexity the task of adding value to the wealth of data becomes difficult. Data mining has emerged as the technology to add value to enormous databases by finding new and important snippets (or nuggets) of knowledge. With large training sets, however, extremely large collections of nuggets are being extracted, leading to much &#034;fools gold&#034; amongst which to fossick for the real gold. Attention is now being directed towards the problem of how to better focus on the most precious nuggets. This paper presents the hot spots methodology, adopting a multi-strategy and interactive approach to help focus on the important nuggets. The methodology first performs data mining and then explores the resulting models to find the important nuggets contained therein. This approach is demonstrated in insurance and fraud applications. 1 Introduction  With the rapid increase in the use of databases together with the dramatic increases in storage capacities and performance man...
PEPNet Parallel Evolutionary Programming for Constructing Artificial Neural Networks.
This paper presents a description of an evolutionary artificial neural network algorithm, EP-Net and its extension taking advantage of a High Performance Computing Environment. PEP-Net, Parallel EPNet, implements four forms of parallelism and this paper describes two of those parallelisms. Experimental studies have shown promising results with better time and prediction performance.  

Templates for Spatial Reasoning in Responsive Geographical Information Systems.


